Papers with stage training process
I Don’t Need Solution. I Need Emotional Support : Empathetic LLMs based on Emotional Validation (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing large language models (LLMs) struggle to generate emotional support response, despite observing and reflecting on the help-seeker’s situation . Empathy drives the formation of constructive interpersonal and supportive relationships, including counseling for mental health care . |
| Approach: | They propose to use a two-stage training process to enhance empathetic response generation through empathy acquisition and emotional validation alignment. |
| Outcome: | The proposed method significantly improves empathetic response generation, achieving superior performance in both automatic and human evaluations. |
Enhancing Large Language Models for Scientific Multimodal Summarization with Multimodal Output (2025.coling-industry)
Copied to clipboard
| Challenge: | Scientific publications are becoming more multimedia, containing both text and visual content. |
| Approach: | They propose a framework for Scientific Multimodal Summarization with Multimodal Output . it leverages the power of large language models and extends its capability to cross-modal understanding . |
| Outcome: | The proposed framework outperforms uni- and multi-modality methods on two new datasets . it leverages the power of large language models and extends its capability to cross-modal understanding . |
Unsupervised Distractor Generation via Large Language Model Distilling and Counterfactual Contrastive Decoding (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent studies show that large-scale models can generate unsupervised DG without expensive distractor annotations. |
| Approach: | They propose a dual task training framework that integrates pseudo distractors from LLMs and answer information as the objective target with a two-stage training process. |
| Outcome: | The proposed method surpasses GPT-3.5-turbo zero-shot performance with 200 fewer model parameters. |
VIMI: Grounding Video Generation through Multi-modal Instruction (2024.emnlp-main)
Copied to clipboard
Yuwei Fang, Willi Menapace, Aliaksandr Siarohin, Tsai-Shien Chen, Kuan-Chieh Wang, Ivan Skorokhodov, Graham Neubig, Sergey Tulyakov
| Challenge: | Existing text-to-video diffusion models rely on text-only encoders for their pretraining, restricting their versatility and application in multimodal integration. |
| Approach: | They propose a multimodal conditional video generation framework for pretraining on augmented text prompts and then utilize a two-stage training strategy to enable diverse video generation tasks within a model. |
| Outcome: | The proposed model can synthesize consistent and temporally coherent videos with large motion while retaining the semantic control. |
Sing it, Narrate it: Quality Musical Lyrics Translation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing song translation approaches prioritize singability constraints at the expense of translation quality, which is crucial for musicals. |
| Approach: | They propose to automatically translate musical lyrics from English to Chinese to ensure high translation quality while adhering to singability requirements such as length and rhyme. |
| Outcome: | The proposed method improves both singability and translation quality over baseline methods and validates its effectiveness. |
Out-of-Domain Intent Detection Considering Multi-Turn Dialogue Contexts (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for OOD intent detection are limited to single dialogue turns. |
| Approach: | They propose a context-aware OOD intent detection framework to model multi-turn contexts in OOD context detection tasks using unlabeled data. |
| Outcome: | The proposed framework improves the F1-OOD score by 29% on multi-turn OOD detection tasks compared to the previous best method. |